Geometric SVM: A Fast and Intuitive SVM Algorithm
نویسندگان
چکیده
We present a geometrically motivated algorithm for finding the Support Vectors of a given set of points. This algorithm is reminiscent of the DirectSVM algorithm, in the way it picks data points for inclusion in the Support Vector set, but it uses an optimization based approach to add them to the Support Vector set. This ensures that the algorithm scales to O(n) in the worst case and O(n|S|) in the average case where n is the total number of points in the data set and |S| is the number of Support Vectors. Further the memory requirements also scale as O(n) in the worst case and O(|S|) in the average case. The advantage of this algorithm is that it is more intuitive and performs extremely well when the number of Support Vectors is only a small fraction of the entire data set. It can also be used to calculate leave one out error based on the order in which data points were added to the Support Vector set. We also present results on real life data sets to validate our claims.
منابع مشابه
Geometric intuition and algorithms for Ev-SVM
In this work we address the Eν–SVM model proposed by Pérez–Cruz et al. as an extension of the traditional ν support vector classification model (ν–SVM). Through an enhancement of the range of admissible values for the regularization parameter ν, the Eν–SVM has been shown to be able to produce a wider variety of decision functions, giving rise to a better adaptability to the data. However, while...
متن کاملECT and LS-SVM Based Void Fraction Measurement of Oil-Gas Two-Phase Flow
A method based on Electrical Capacitance Tomography (ECT) and an improved Least Squares Support Vector Machine (LS-SVM) is proposed for void fraction measurement of oil-gas two-phase flow. In the modeling stage, to solve the two problems in LS-SVM, pruning skills are employed to make LS-SVM sparse and robust; then the Real-Coded Genetic Algorithm is introduced to solve the difficult problem...
متن کاملDetection of some Tree Species from Terrestrial Laser Scanner Point Cloud Data Using Support-vector Machine and Nearest Neighborhood Algorithms
acquisition field reference data using conventional methods due to limited and time-consuming data from a single tree in recent years, to generate reference data for forest studies using terrestrial laser scanner data, aerial laser scanner data, radar and Optics has become commonplace, and complete, accurate 3D data from a single tree or reference trees can be recorded. The detection and identi...
متن کاملSimulation and prediction of scour whole dimensions downstream of siphon overflow using support vector machine and Gene expression programming algorithms
Background and Objectives: The purpose of this study is to simulate and predict the dimensions of the scour cavity downstream of the siphon overflow using the SVM model and compare it with other numerical methods. The use of the SVM algorithm as a meta-heuristic system in simulating complex processes in which the dependent variable is a function of several independent variables has been widely ...
متن کاملDuality and Geometry in SVM Classifiers
We develop an intuitive geometric interpretation of the standard support vector machine (SVM) for classification of both linearly separable and inseparable data and provide a rigorous derivation of the concepts behind the geometry. For the separable case finding the maximum margin between the two sets is equivalent to finding the closest points in the smallest convex sets that contain each clas...
متن کامل